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Consider an operator equation F(u) = in a real Hilbert space. Let us call 
this equation ill-posed if the operator F'(u) is not boundedly invertible, and 
well-posed otherwise. If F is monotone Cf oc (H) operator, then we construct 
a Cauchy problem, which has the following properties: 1) it has a global 
solution for an arbitrary initial data, 2) this solution tends to a limit as time 
tends to infinity, 3) the limit is the minimum norm solution to the equation 
F{u) = 0. 

Example of applications to linear ill-posed operator equation is given. 

1 Introduction 

Many physical problems can be formulated as operator equations. In this 
paper a general convergence theorem is proved for solving operator equations 
with monotone operators. Consider an operator equation 

F(u) := B(u) — f — 0, fEH, (1.1) 

where B is a monotone, nonlinear, Cf oc operator in a real Hilbert space H, 
i.e, sup ueB{u(hR) \\FW(u)\\ < Mj(R) := Mj, j = 0, 1,2, where R > is arbi- 
trary, B(u , R) :— {u : \ \u — u || < R}, F^\u) is the Frechet derivative. Let 
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N := {z : F(z) = 0}. It is known that iV is convex and closed under our 
assumptions. Assume that N is not empty. Then it contains the unique min- 
imum norm element y: F(y) = 0, ||y|| < \\z\\, G N. These assumptions 
hold throughout and are not repeated. 

Let u denote derivative with respect to time. Consider the dynamical 
system ( the Cauchy problem ): 

ii = $(t,u), u(0) = u ; $ := -A'^F + eu], (1.2) 

where A e := A+el, A := F'(u), I is the identity operator, and e — e(t) > is 
a continuously differentiable, monotone, decaying to zero as t — > oo, function 
on [0, oo). Specifically, we will use e = c\{cq + t)~ b , where c\,co and b are 
positive constants, b G (0, 1), and assume throughout (without repeating), 
that |e|e _1 < 0.25. Note that $(t, u) is locally Lipschitz with respect to 
u G H and continuous with respect to t > under our assumptions. Thus 
problem (1.2) has a unique local solution. We want to solve equation (1.1) by 
solving (1.2), and proving that for any initial Uo the following three results 
hold: 

3u(f)Vf > 0; 3m(oo) := lim u(t); F(u(oo)) = 0. (1.3) 

Moreover, we prove that the solution u G B(u ,R) Vt > 0, where R := 3r, 
and r := | \y\ | + | |uo||- 

Problem (1.1) with noisy data fs, \\fs — f\\ < 5, given in place of /, 
generates the problem: 

u s = $ s (t,u s ), u s (0)=u , (1.4) 

The solution u$ to (1.4), calculated at a suitable stopping time t — t$, con- 
verges to y: 

lim \\us(ts) - y\\ = 0. (1.5) 

The choice of ts with this property is called the stopping rule. One has 
usually lim^o^ = oo. 

We do not restrict the growth of nonlinearity at infinity and do not assume 
that the initial approximation Uq is close to the solution y in any sense. 
Usually (e.g., see [2]) convergence theorems for Newton-type methods for 
solving nonlinear equation (1.1) have the assumption that the initial data 
uo is close to y. We obtain a global convergence result for a continuous 
regularized Newton-type method (1.2). This result is stated in Theorem 1, 
and proved in Section 2. 
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Theorem 1. For any choice of uq problem (1.2) has a global solution, 
this solution stays in the ball B(uq,R), and (1.3) holds. Ifu$(t) solves (1-4), 
then there is a t$ such that lim^o 1 1^5(^5 ) ~ y\ \ = 0. 

The proof uses essentially the following result which is obtained in [1] . 

Theorem 2. Let ^(t) : a(t), fi(t) G C[t , oo) for some real number t . If 
there exists a positive function fi(t) G C 1 ^, oo) such that 

(1.6) 

where go is the initial condition in (1.7), then a nonnegative solution g to the 
following differential inequality: 

g(t) < -l{t)g{t) + o-(t)g 2 (t) + P(t), g(t ) = g , (1.7) 

satisfies the estimate: 

°^v^-wr<wr (L8) 

for all t G [to, oo), where 

< K0 = f n -7^77^ + I f Us) - ^r) ds) 1 . (1.9) 



1-H(t )g(t ) 2 7 t0 V Ks) 

There are several novel features in this result. First, differential equation, 
which one gets from (1.7) by replacing the inequality sign by the equality 
sign, is a Riccati equation, whose solution may blow up in a finite time, in 
general. Conditions (1.6) guarantee the global existence of the solution to 
this Riccati equation with the initial condition (1.7). Secondly, this Ric- 
cati differential equation cannot be integrated analytically by separation of 
variables, in general. Thirdly, the coefficient a(t) may grow to infinity as 
t — > oo, so that the quadratic term does not necessarily has a small coeffi- 
cient, or the coefficient smaller than "f(t). Without loss of generality one may 
assume /3(t) > in Theorem 2. In [4] and [5] one finds a description and 
applications of DSM (dynamical systems method) and some remarks about 
discrepancy principle, which are useful in treating problems with noisy data. 
Many physical problems can be formulated as operator equations with mono- 
tone operators. We mention the theory of passive networks (see [7] and [8], 
Chapter 3) as just one of many examples. 
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2 Proof of Theorem 1 



Let us sketch the proof. Denote w := u — V, \\w\\ :=g,v:= \\V — y\\. Clearly 
| \u(t) — y\ | < g + v. We will prove that lim^oo g = lim^oo v — 0. 
Let V solve the equation 

F(V) + e(t)V = 0. (2.1) 

Under our assumptions on F, it is known that (2.1) has a unique solution for 
every t > 0, and lim^oo ||V(t) — y|| = 0. One can prove that sup t>0 ||V|| < 
||y||, V is differentiable, and ||V"(i)|| < ||y|||e(t)|/e(t). We will show that the 
global solution u to (1.2) does exist, and lim^oo \ \u(t) — V(t)\\ = 0. This is 
done by deriving a differential inequality for w, and by applying Theorem 2 
to g — \\w\\. Since \\u(t) — y\\ < g + v , it then follows that (1.3) holds. We 
also check that u(t) G B(uo,R), where R := 3(||y|| + ||wo||), for any choice of 
Uq and a suitable choice of e = e(t). 

Let us derive the differential inequality for w. One has 

w = -V- A-^u) [F(u(t)) - F(V(t)) + e(t)w], (2.2) 

and F(u) - F(V) = Aw + K, where \\K\\ < M 2 g 2 /2, g := \\w\\. Multiply 
(2.2) by w, use monotonicity of F, i.e., the property A > 0, and the estimate 
| |V"| | < ||y|||e|/e, and get: 

0.5Mg 2 ..lei , , 

g<-g + ^^- + \\y\\^, (2.3) 

where M := M 2 . Inequality (2.3) is of the type (1.7): 7 = 1, a = 0.5M/e, 
P = WvW^r- Choose /j,(t) = 2M/e(t). Clearly /j, — > 00 as t — > 00. Let us 
check three conditions (1.6). One has ^ = |e|/e. Take e = Ci(c + t)~ 6 , 
where Cj > are constants, < b < 1, and choose these constants so that 
|e|/e < 1/2, e.g., ^- = |. Then the first condition (1.6) is satisfied. The 
second condition (1.6) holds if (*) 8M| \y\ | |e|e -2 < I. One has e(0) = CiCq 6 . 
Choose e(0) = 4Mr. Then |e|e" 2 = bc^(c + tf' 1 < bc^c^c* = 4^57 = 
1 ^ Mr - Thus, the second condition (1.6) holds. The last condition (1.6) holds 
because 2M\\u - V o \\/e(0) < ff£ = \ < 1. 

Thus, by Theorem 2, g = \\w(t)\\ < |^ — > when t — > 00, and ||u(i) — 
M o|| < fi , + ||^ /— M o|| < fi , (0)+?" < 3r. This estimate implies the global existence 
of the solution to (1.2), because if -u(t) would have a finite maximal interval 
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of existence, [0,T), then u(t) could not stay bounded when t — > T, and this 
contradicts the boundedness of ||tt(t)||, which follows from our estimates: 
I \ u {t) 1 1 < 4r. We have proved the first part of Theorem 4.2, namely properties 
(1.3). □ 

To derive a stopping rule we argue as follows. One has ||w«5(£) — y\\ < 
| \u$(t) — V(t)\\ + \ \V(t) —y\ \ := gs + v. We have proved that lim^oo v(t) := 0. 
The rate of decay of v(t) can be arbitrarily slow, in general. Additional 
assumptions, e.g., the source-type ones, can be used to estimate the rate 
of decay of v(t). One can derive differential inequality similar to (2.3) for 
gs '■= \\us(t) — V(t)\\, and estimate gs using (1.8). The analog of (2.3) for 
gs contains additional term 8/e on the right-hand side. If 1QM5 < e 2 , then 
conditions (1.6) hold, and gs < Let ts be the root of the equation 

e 2 (t) = 16M5. Then lim^o^a = oo, and lim^o — y\\ — 0, because 

\\us(ts) ~y\ \ < v(t s ) +g s , limt^oo g s (t s ) = and lim ti _ >00 ?;(i 5 ) = 0, but the 
convergence can be slow. See also [3] for the rate of convergence under source 
assumptions. If the rate of decay of v(t) is known, then one can choose ts as 
the minimizer of the problem, similar to (3.13), v(t) + gs(t) = min , where 
the minimum is taken over t > for a fixed small 5 > 0. This would yield a 
quasioptimal stopping rule. Theorem 1 is proved. □ 



3 Example 

Let us give an example of applications of Theorem 1. Consider a linear 
operator equation: 

Au = f. (3.1) 

Let us denote by A) the folowing assumption: 

Assumption (A): A is a linear, bounded operator in H, defined on all 
of H , the range R{A) is not closed, so (3.1) is an ill-posed problem, there is 
a y such that Ay — f , y ± N , where N is the null-space of A. 

Let B := A* A, q := By = A*f, A* is the adjoint of A. Every solution to 
(3.1) solves 

Bu = q, (3.2) 

and, if / = Ay, then every solution to (3.2) solves (3.1). Choose a continuous 
function e(t) > 0, monotonically decaying to zero on R + , as in Theorem 
1. If B is a linear operator, and F(u) := Bu — q, then F'(u) = B, and 
$ := -(B + e^lBu-q + eu] = -u + (B + e(t))~V Therefore equation (1.2) 
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takes the form: 



u = -u + (B + e(t)) _1 g, u(0)=u . 



(3.3) 



The operator B := A* A > is linear, monotone, and Theorem 1 is applicable. 
Therefore conclusions (1.3) hold for the solution to (3.3), and, since equations 
(3.1) and (3.2) are equivalent if (3.1) is solvable, one concludes that u(oo) = 
y, where y is the unique minimal-norm solution to equation (3.1). Moreover, 
if the data are noisy, so that f$ is given in place of /, and ||/ — fg\\ < 5, 
then Theorem 1 yields a stable solution to the ill-posed problem (3.1). Thus, 
Theorem 1 yields a method for solving arbitrary linear ill-posed problems 
with bounded linear operator A. This method works well numerically. 

4 Appendix 

For convenience of the reader and for completeness of the presentation we 
include a proof of Theorem 2 which is borrowed from [1]. 
We start with the well-known lemma (see, e.g. [6]): 

Lemma. Let f(t,w), g(t,u) be continuous on region [0, T) x D (D C R, 
T < oo) and f(t,w) < g{t,u) if w < u, t e (0,T), w,u G D. Assume that 
g(t,u) is such that the Cauchy problem 



then u(t) > w(t) for all t for which u(t) and w(t) are defined. 
Let us now prove Theorem 2. 
Proof of Theorem 2. 

Let g be the function from (1.7). Define the new function w by the 



ii = g(t,u), u(0) = u , Uq G D 



has a unique solution. If 



w < f(t,w) 



w(0) = wo < uo, wo G D 



formula: 



W W : = 9if)e 



,/t' ~f( s ) ds 



Then 



w(t) < a(t)w 2 (t) + b(t), w(t ) = g(t ), 



where 



a(t) = a{t)e 



ft t( s ) ds 



b(t) = (3(t)e 
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Consider the equation: 



•ffy /(*) 2M G(t) 

uit) = W) u {t) " WY 



(4.1) 



One can check by a direct calculation that the the solution to this equation 
is given by the following formula (see [6]): 



u(t) 



G(t) 
f(t) 



G(s)P(s) 



ds 



where C is a constant. If u(0) = u , then C = U() f2^^ G ^f^ ■ 
G as follows: 



(4-2) 
Define / and 



f(t) := ^(t)e-^^ {s)ds , G(t) := -^(t)e^^ {s)ds , 

and consider the Cauchy problem for equation (4.1) with the initial condition 
u (to) — 9 (to)- Then C in (4.2) can be calculated: 



C 



1 



M*oM*o) - 1 



From (1.6) one gets 



Since f'G = — 1 one has: 
" f(s) 



Thus 

u(t) 



to G(s)P(s) 



e I to f( s ) ds 



ds 



n(t) 



t f(s) 2 



+ 



to 



l-fi(t )g(t ) 2j tQ 



7 (s) 



7 (s) 



/i(s) 



(is. 



-i 



•3) 

It follows from conditions (1.6) and from the second inequality in (1.6) that 
the solution to problem (4.1) exists for all t G [0, oo) and the following 
inequality holds with u(t) defined by (1.9): 



1 > 1 - v(t) > fJ.(t )g(t ) 
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From Lemma and from formula (4.3) one gets: 



/ ,\ 7 (s)ds / ,x ^ U \ 1 _ ^(*) ft ~f( s ) ds ^ 1 ft l( s ) ds 

g{t)e Jt o H ; := w(t) < u(t) = -— — e Jt o n ' < — e Jt o ,v ; , 

and thus estimate (1.8) is proved. Theorem 2 is proved. □ 
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